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DETAILED ACTION 
Claim Objections 

Claim 20 is objected to because of the following informalities: Claim 20 depends 
from claim 29. The examiner notes that it appears that claim 20 should depend from 
claim 19. Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

1. Claims 1-5 and 7-1 1 are rejected under 35 U.S.C. 102(b) as being anticipated by 

Sankrithi et al. (6405975), (hereinafter referred to as "Sankrithi"). 

Regarding claim 1, Sankrithi discloses an apparatus that relates to 
airplane ground maneuvering systems (Sankrithi: column 1, lines 12-13). This 
apparatus comprises "at least one sensor operable to capture images 
representing scenery outside the vehicle" (Sankrithi: column 3, lines 53-55, 
wherein the sensor is the camera), "a protective housing enclosing the sensor, 
wherein the housing further comprises a transparent aperture through which the 
sensor captures images" (Sankrithi: column 9, lines 1-15, wherein the aperture is 
the clear lens), "a cleaning mechanism operable to remove obstructions from the 
aperture" (Sankrithi: column 9, lines 1-15, wherein the window cleaning is the 
cleaning mechanism), and "an operator display through which images 
representing the scenery outside the vehicle are displayed" (Sankrithi: figure 
6A). 
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Regarding claim 2, Sankrithi discloses "wherein the sensor comprises a 
camera" (Sankrithi: column 3, lines 53-55). 

Regarding claim 3, Sankrithi discloses "the aperture further comprises a 
rotating conical surface, wherein an outer surface is wiped within the housing to 
remove obstructions" (Sankrithi: figures 10 and 11, wherein the rotation is 
illustrated; column 9, lines 10-15, wherein the wiping is performed by the rubbery 
squeegee). 

Regarding claim 4, Sankrithi discloses "the cleaning mechanism is located 
to not obstruct the sensors field of view" (Sankrithi: figure 11; column 9, lines 1- 
1 5, wherein the wiper housing 452 is mounted to the plane away from the 
camera). 

Regarding claim 5, Sankrithi discloses "the camera further comprises an 
infrared camera" (Sankrithi: column 13, lines 43-46). 

Regarding claim 7, Sankrithi discloses "the cleaning mechanism 
comprises a cleaning fluid applicator that applies cleaning solution to the 
aperture" (Sankrithi: column 9, lines 10-15, wherein the cleaning solution is the 
combination of the air mixed with water, antifreeze, or cleaning solution). 

Regarding claim 8, note the examiners rejection for claim 1, and in 
addition Sankrithi discloses "images representing scenery outside the vehicle are 
derived from captured images from the sensor" (Sankrithi: column 3, lines 53-55, 
wherein the camera derives the images). 

Regarding claim 9, note the examiners rejection for claim 2. 
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Regarding claim 10, Sankrithi discloses "the vehicle comprises an aircraft" 
(Sankrithi: column 3, lines 44-47). 

Regarding claim 1 1 , note the examiners rejection for claim 5. 
Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 6 and 12-15 are rejected under 35 U.S.C. 103(a) as being unpatentable 

over Sankrithi et al. (6405975), (hereinafter referred to as "Sankrithi"). 

Regarding claim 6, although not disclosed, it would have been obvious for 

the cleaning mechanism to comprise a mechanical brush (Official Notice). Doing 

so would have been obvious in order to help remove debris from the lens of the 

camera. 

Regarding claim 12, note the examiners rejection for claim 6. 

Regarding claim 13, note the examiners rejection for claim 7. 

Regarding claim 14, note the examiners rejection for claim 1, and in 
addition, Sankrithi discloses "sending images of a portion of the out-the-window 
scene from the viewpoint of the sensor" (Sankrithi: figure 6A, wherein the 
images are sent to the display) and "outputting image of the scenery outside the 
vehicle to a first display, wherein the display device is positioned to provide the 
portion of a desired out-the window visual scene in combination with a window 
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that provides another portion of the desired out-the-window visual scene" 
(Sankrithi: figure 6A, wherein multiple views are displayed to the user). 

Regarding claim 15, although not disclosed, it would have been obvious to 
mount the second camera within a protective housing (Official Notice). Doing so 
would have been obvious in order to protect the camera against the influence of 
outside elements). 

3. Claims 16-33 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Sankrithi et al. (6405975), (hereinafter referred to as "Sankrithi") in view of Jamieson et 
al. (6665063), (hereinafter referred to as "Jamieson"). 

Regarding claim 16, note the examiners rejection for claim 1 , and in 
addition, claim 16 differs from claim 1 in that claim 16 further requires fusing two 
image together. Jamieson teaches that for manned aircraft, collisions with 
ground and air based obstacles results in numerous fatalities each year 
(Jamieson: column 2, lines 32-35). To help alleviate this problem, Jamieson 
discloses "images from the first and second sensor are fused to create a first 
fused image" (Jamieson: figures 13A and 14A, wherein the images are fused or 
combined to produce the output image). Therefore, it would have been obvious 
to one having ordinary skill in the art at the time the invention was made to take 
the apparatus disclosed by Sankrithi and add the processing taught by Jamieson 
in order to obtain an apparatus that helps prevent aircraft collisions. 
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Regarding claim 17, Jamieson discloses "combining the fused image with 
symbols representing objects" (Jamieson: figures 13A and 14A, wherein the 
symbols are the circles and lines representing objects). 

Regarding claim 18, Jamieson discloses "fusing the first fused image with 
an enhanced image from at least one of RADAR and a FLIR sensor" (Jamieson: 
column 16, lines 5-10). 

Regarding claim 19, note the examiners rejection for claims 1 and 14, and 
in addition Sankrithi in view of Jamieson disclose "transform the first sensor 
image to a viewpoint image from an operator station in the device, wherein the 
viewpoint image is seized and oriented to conform to the scenery outside the 
device from the operator station" (Sankrithi: figures 16A and 16B, wherein the 
image is defined within the field of view and oriented to fit the display; Jamieson: 
figures 13A and 14A). 

Regarding claim 20, Jamieson discloses "the symbols represent 
information regarding the operation state of the device and the moving objects 
detected in the image" (Jamieson: column 16, lines 25-30, wherein the operation 
state information is the velocity, speed, and heading; column 16, lines 31-35, 
wherein the distance to the object is displayed). 

Regarding claim 21, note the examiners rejection for claim 20. 

Regarding claim 22, although not disclosed, it would have been obvious to 
generate a symbol representing weather hazards (Official Notice). Doing so 
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would have been obvious in order to more easily warn the pilot of adverse • 
weather conditions. 

Regarding claim 23, Jamieson discloses "receive an enhanced image in 
low-visibility conditions" (Jamieson: column 16, lines 5-10, wherein the RADAR 
or FLIR provide the image in low-visibility conditions). 

Regarding claim 24, Jamieson discloses "fuse the viewpoint image with 
the enhanced image" (Jamieson: figures 13A and 14A). 

Regarding claim 25, Jamieson discloses "utilize data form a position 
sensor to determine the location of the objects" (Jamieson: column 16, lines 31- 
35, wherein the location of the object is determined with respect to the aircraft). 

Regarding claim 26, Jamieson discloses "utilize data form off-board data 
sources regarding the objects" (Jamieson: figure 36, wherein the 
transmit/receive fiber bundles receive off-board data). 

Regarding claim 27, note the examiners rejection for claim 2. 

Regarding claims 28-29, Jamieson discloses the sensor is a RADAR and 
FLIR sensor" (Jamieson: column 16, lines 5-10). 

Regarding claim 30, Sankrithi discloses "generate a common display area 
associated with two mutually exclusive windows of information on the display 
device, the area being customized by the operator to display detailed 
information" (Sankrithi: figure 6A; column 6, lines 23-25, wherein the knob 
adjusts the displays). 
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Regarding claim 31, note the examiners rejection for claims 1, 14, and 15, 
and in addition Sankrithi in view of Jamieson disclose "first and second display 
devices" (Sankrithi: figure 6A), "outputting the two viewpoints to the first and 
second display devices" (Sankrithi: figure 6A). 

Regarding claim 32, Jamieson discloses "combining the image with 
symbols representing the objects and primary flight information" (Jamieson: 
column 16, lines 25-30, wherein the primary flight information is the velocity, 
speed, heading, and power levels). 

Regarding claim 33, note the examiners rejection for claim 18. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

US-6672535 01-2004 Brunner Jr et al. 
US-5415549 05-1995 Logg 

US-5574497 1 1 -1 996 Henderson et al. 

US-7002600 02-2006 Okada et al. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dave Czekaj whose telephone number is (571) 272- 
7327. The examiner can normally be reached on Mon-Thurs and every other Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571) 272-7418. The fax phone 
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number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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